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LEARNING 


FEEDBACK FROM STUDENTS (OR WHAT YOU DON'T KNOW MAY BE HURTING YOU) 


While there are a number of different procedures for collecting 
information about teaching, the one most frequently employed in universities 
is the student end-of-course questionnaire. While these questionnaires are 
useful for gathering information which is relevant for evaluation (personnel) 
purposes, they are probably not the best procedure for providing individual 
faculty members with the kind of detailed information which can assist them 
in making specific changes in their own courses or methods. There are two 
main reasons for this. First, the end-of-course evaluation information comes 
back to instructors at a time when it is too late to make any changes which 
might benefit the students who have provided it. Second, the information is 
usually of too general a nature to give instructors specific cues as to what 
Changes they might make in a given course. 


Here are several ways to collect useful information in time to 
benefit the students who provide it. Some of these methods are simple and can 
be put into immediate effect, others are more elaborate and require planning, 
technical assistance or financial support. The ultimate worth of any of 
these methods is, of course, its usefulness to the individual instructor. 


Student Liaison Committee: Establish a Liaison Committee of 3-5 students 

to meet with you once a week to discuss how the course is proceeding (its 
high points and its low points, student difficulties or dissatisfactions, 
etc.). In a very large class the students should probably be selected on a 
"district" basis within the seating arrangement of the room so that all 
students have relatively easy access to one or more members of the committee. 
Rotate membership on the committee from a list of volunteers if that seems 
desirable, but be sure other students know who the liaison students are at 
any given time. 


Student Lecture Notes: The difference between what a teacher says and what 
each student hears is often not apparent to either faculty or students. Ask 
all or a sample of students to lend you their notes at the end of a lecture 
session so that you can compare them with your own outline or with an audio- 
tape of the lecture. If desirable, the anonymity of students' notes may be 
preserved by using code identification. This exercise can be particularly 


useful if students have rated you low on 
organization and clarity of presentation 
in previous classes and you wish to under- 
stand the problem more concretely and try 
to do something about it. 


Videotaping: Have one or more of your 
classes videotaped. Often it is more in- 
structive to have the camera concentrate 
on the students rather than on you. 

Then look at the tape - as many times as 
you wish - each time analyzing something 
different about your teaching, e.g., your 
skills as a discussion leader, the attent- 
iveness of your students, the organization 
and clarity of your lectures, the kinds of 
questions you ask students, and the way 
you respond to their answers. 


Colleague Visitation: Invite a teaching 
colleague to visit one of your classes,to 
observe the instructional process, and to 
make suggestions. This procedure is prob- 
ably most useful when you have had some 
discussion beforehand about what you are 
trying to accomplish in the class or the 
particular technique you are trying to 
perfect so that your colleague can focus 
his or her observations. This will make 
the task easier for your colleague and 
his observations more useful to you. 


Telephone Answering Service: Install a 
24-hour telephone tape answering service 
for student use in submitting questions or 
relating difficulties that they are having 
in a course. By listening to the taped 
calls each morning, you and/or your T.A.'s 
can make plans to respond to students’ 
questions or problems at the next class 
meeting. This method has the advantages 
of immediate, anonymous feedback from 
those students who are experiencing diff- 
iculty or dissatisfaction at the time 

they are experiencing it (e.g., 3:00 a.m. 
while working a problem set). It is 
probably most appropriate (and economic- 
ally feasible) in very large courses 

where sheer numbers make personal commun- 
ication between student and teacher diffi- 
cult and/or in courses where students are 
given frequent assignments. 


Focussed quest ionnaries: Distribute a 
brief evaluation form to a small random 
sample of students in a large class.This 
"questionnaire" can be as simple as a 
blank 3" x 5" card on which students are 


asked to comment on what happened in 

Class that day or a half-page mimeo- 
graphed sheet asking about several spec- 
ific features of the course to date (e.g.) 
experimental aspects, traditionally diffi- 
cult assignments, aspects of your teach- 
ing performance which you feel may need 
changing, etc.). This method has the 
advantage of providing immediate feed- 
back while there is still time to take 
some action on the basis of it. It also 
reduces the number of questionnaire 
responses (through sampling) which must 
be read and analyzed. Repeat the process 
with the same or a different "question- 
naire" whenever you feel the need for 
feedback or information on some spec- 

ifie topic. 


Maaction from "The Evaluation of University 


Teaching:Ten Faculty Initiated Methods for 
Getting Feedback for Improving Instruction". 
TIES, Berkely, California. 


L.D.0. SPONSORED EVENTS 


Oct.26th - Workshop on "Identifying & 
Solving Instructional Problems". 


Location - Hall Building 762-1 
Time - 2:00 PM. 
Staff - Ron Smith 
Marilyn Callan 
Jane Magnan 


Brown Bag Luncheons 


Oct. 29th - Dr. Marilyn Taylor will be 


discussing "Learning from the Inside Out 
The Learner's Perspective of Learning". 


and the work she has done in connection 
with the Ontario Institute for Studies 
in Education. 

1:00 p.m. - Hall 501 

Sir George Campus 


Nov. 14th - Jane Magnan will be discuss 
ing the book "Theory in Practice: Increas 


ing Professional Effectiveness by Chris 
Agryis & Donald A. Schon. 


1:15 p.m. - L.D.0. reading 


room. 
2492 W. Broadway 
Loyola Campus. 
Bring your lunch, we'll provide coffee & 
stimulating conversation. 
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LARGE CLASSES - WHAT CAN YOU DO? 


Large classes cause many problems and 
for those faculty at Concordia suddenly 
faced with a large class (from 50 to 500 
students) some of the difficulties become 
all too apparent. Many of them are logis- 
tical: assignments and tests, grading and 
office hours. Some of them are methodo- 
logical-a discussion style that proved 
very effective in a class of 30 can no 
longer be applied to a class of 300. What 
do you do? This article will deal with 
two faculty members; Professor Marcel 
Goldschmid of McGill University and Prof- 
essor Peter Pasold of Concordia, and the 
techniques they have created to help them 
deal with their large classes. 


Under the assumption that students 
need to be active sometimes, that it is 
beneficial for there to be an exchange 
amongst students themselves and that there 
is some recognition of individual student 


differences in the class; Marcel Goldschmid* 


designed a course for 300 students at 
McGill that included several instructional 
options. At the beginning of the course 
he described each of the four options 
available - discussion, seminar, learning 
cell and essay - and asked the students 
to choose the one they found personally 
most suitable. 


In the discussion groups six to twelve 
students met twice a week for one hour. 
They chose a topic and specific reading 
assignments before each meeting. In add- 
ition to the reading, they prepared quest- 
ions and comments for the discussion. 


In the seminar group, three to four 
students individually prepared a short 
five-minute paper which they presented to 
the group of ten to twelve students in 
each of the two weekly meetings. Each 
presentation was followed by a group dis- 
cussion, 


The third option was a learning-cell 
approach. Pairs of students were formed 
who interacted with each other during each 
of the two weekly one-hour sessions. The 
partners in the five to six pairs or cells 
rotated after each hour among a total 
group of ten to twelve students. This 
approach can take either of two forms: 


the two students in a cell can either 
both read the same material or choose 
different topics and prepare a series of 
questions. In the first situation,stud- 
ent A asks his first question and stud- 
ent B attempts to answer and then B asks 
his first question which student A will 
try to answer. What develops is a rather 
rapid flip-flop and intensive exchange 
between the two students throughout the 
hour. In the second alternative student 
A first teaches the essence of his mater- 
jal to student B and then asks his quest- 
ions. At the mid-point of the hour, they 
reverse their roles; student B presents 
his material and asks questions and 
student A tries to answer. 


The fourth option, the essay option, 
involved few meetings with other students, 
but a great deal of independent reading 
and the preparation of a long essay. 
Students would only meet four times during 
the course to discuss their outline, two 
progress reports and the summary of their 
conclusions, respectively. 


The course was a half-course on Person- 


ality. It was given in the Fall (260 
students) and repeated in the Spring (160 
students). Four graduate students assis- 
ted Marcel in supervising and evaluating 
the students and each instructional opt- 
ion. 


A great deal of data was collected 
in order to assess the effectiveness of 
this approach. A personality test (CPI), 
an objective achievement test on the sub- 
ject matter of the course, a questionnaire 
on student background characteristics were 
all given at the beginning of the course. 
On these measures no significant differ- 
ences between the students in the four 
options emerged. 


During the courses students were 
asked to check off their personal  feel- 
ing about the course after each meeting 
on a 10-point "Morale barometer". To- 
wards the end of the course the students 
took a final examination based on a text 
book which was not discussed in any of 
the four options and was in addition to 
the work done there. Finally, all stud- 
ents filled out a long questionnaire 
which permitted subjective evaluation of 
all important aspects of the course. 
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It is impossible to list all the find- 
ings here, but a few representative results 
are presented below: 


- Morale was high in all four options. 
The average ratings for the entire class 
on the 10-point scale ranged from 7.2 for 
the essay option to 8.2 for the learning 
cell option. 


- The students in the learning-cell 
option achieved the highest scores on the 
unannounced essay examination. 


- No significant differences were 
found between the four groups on the final 
examination which was independent of the 
work done in the four learning options. 


- Peer and self evaluations of 
achievement were highest for the learning 
cell. 


At Concordia, Peter Pasold, Professor 
of Marketing on the. Sir George Campus has 
designed a method of teaching his classes 
of 600 and 200 respectively, in a somewhat 
novel manner. His concern was with indi- 
vidualizing the course as much as he 
could given the restrictions that numbers 
placed on him. During our annual resident- 
ial workshop at Lacolle, Peter constructed 
a model of teaching adapted from the 
"Keller Plan". 


The Keller Plan is an individually 
student paced, student tutored and mastery 
oriented instructional design. We haye 
more information on Keller in our Office. 
Printed student guides are used for com- 
munication and a few lectures are given 
by the instructor, usually for stimulation 
and motivation of students. 


A student entering a Keller course 
finds that the course work is divided in- 
to clearly defined topics or units. Ina 
Simple case, the content of a unit may 
correspond to a chapter in.the text. 
Study guides are used to guide or direct 
the student's work on each unit. Study 
guides introduce the unit, state student 
objectives for the unit,suggest study pro- 
cedures and list study questions. The 
student may work anywhere to achieve the 
objectives outlined in the study guide. 


Before moving on to the second unit, 


the student must demonstrate mastery of 
the first unit by perfect or near-perfect 
performance on a short examination. The 
student requests the exam when he or she 
feels prepared. Each unit must be passed 
before subsequent units can be attempted. 
Students are able to meet all course 
requirements before the term is half 
through;other students may require more 
than a term for completing the course. 


The staff needed for implementing 
such a plan includes the instructor and 
undergraduate or graduate student, tutors 
or proctors. The instructor selects and 
organizes material used in the course, 
writes study guides and constructs the 
examinations for the course. A few 
lectures or demonstrations may be given 
during the course. The lectures are not 
compulsory and no examinations are based 
on them. They can be used to stimulate and 
motivate the students, to provide overviews 
of the material or to present alternative 
approaches. 

The undergraduate tutors are usually 
advanced majors in the field or people who 
have done well in the course the year be- 
fore. Tutors evaluate unit tests as 
satisfactory or unsatisfactory. They 
also prescribe remedial steps for students 
who encounter difficulties with the course 
material and offer support and encourage- 
ment for all students. 


Although the Keller Plan has proven 
to be an excellent method of instruction 
which ensures retention of material, a 
more personalized and individualized 
approach to teaching classes, it also 
has some drawbacks. Some of these are 
administrative (Peter anticipated having 
to grade 22,400 tests/supervise 80 tutors). 
Managing the paper and the people can be- 
come a headache. Using some of the 
basic guidelines laid out by Keller such as 
a programmed text; the concept of mast- 
ery learning and using small units of 
instruction, Professor Pasold created an 
organizational structure which bypassed 
some of the intrinsic difficulties of the 
Keller plan. 


Students were given an outline of 
all the materials, assignments, exercises 


etc., that they were expected to cover in 
class. This material was divided into 8 
units. Each unit had a small test that the 
students could take with a choice of 8 
sittings over a 4 week period. To get 
credit for the unit they must "master" it 
by getting the equivalent of an A on the 
test. The tests can be taken several 
times until it is mastered but for logis- 
tical reasons, there is a 1 mark penalty 
for every unsuccessful attempt at the 
test. 


Unit tests are worth 56% and the 
final exam 44%. Lectures are optional and 
Pasold has nine tutors, 8 of whom give 
3-1/2 hours of tutorial a week. 


Peter intends to record the effect of 
this model and would be willing to talk 
to others about its practicality and or- 
ganization. 
* Information adapted from: 
"Instructional Options: Adapting the Large 
University Courses to Individual Differen- 
ces" by Marcel L. Goldschmid - Learning & 
Development Newsletter February 1970 - 
Vol. 1 No. 5. (available in our Office). 


Articles on Large Clases available in 
.U. read om: 


. "On Making a Big Lecture Section a 
'Good' Course" by John W. Wick. 


Profiles in College Teaching: Models at 


Northwestern 


Editor Mathis, B. Claude & McGaghie, 
William C., Northwestern University 1972. 


"The Learning Cell - An Instructional 
Innovation" by Marcel L. Goldschmid - 
Learning & Development Newsletter - Jan- 
uary 1971 - Vol. 2 No. 5 


"Instructional Options: Adapting the Large 
University Course to Individual Differences" 
by Marcel L. Goldschmid - Learning & Devel- 
opment Newsletter February 1970 - Vol.1 No.5 


Teaching Tips: A Handbook for the Begin- 
ning College Teacher by Wilbert McKeachie. 


"Undergraduate Discussion Leaders for 
a Large Lecture Class" by John F. 
Schmerler. Improving College & 
University Teaching Fall '74. 


"How to Handle Large Classes" by 
John B. White. Improving College & 
University Teaching - Fall '74. 


"Effect of Teacher, Student & Class 

Characteristics or the Evaluation of 
College Instruction". - Patricia B. 
Elmore & John T. Pohlman. Journal of 


Educational Psychology April 1978. 


PROFESSIONAL DEVELOPMENT ACTIVITIES: 


. New Approaches to Academic Design & 
Instruction. 


Dec. 7 - 9. 1980 
New Orleans, Louisiana 


March 9 - 11, 1980 
Washington, D.C. 


Staff - Dr. William Bergquist 
Dr. David Halliburton 


Fee - $250.00 (includes room & board) 


. Academic Passages: A Workshop on 
Career Development 


May 9 - 11, 1980 
Atlanta, Georgia. 


Staff - Dr. Steven Phillips 
Dr. Gene Rice 


Cost - $250.00 (includes room & board) 


. The Faculty Membor as Person & 
Professional: A Workshop on Faculty 
Development. 


January 6 - 12, 1980 - Denver, Colorado 
Staff - William Bergquist, David 
Halliburton, Gene Rice, Joan North, 
Steven Phillips. 


Cost - $425.00 


4. David Kolb Workshop on Learning Styles 
Nov. 8 - 9 

Centre for Human Relations & Community 
Studies. 

Cost - $150.00 

For more information call L.D.0. at 397 


